Image Based View Localization System Retrieving from a Panorama Database by SURF

We propose a system for estimating a user’s view direction with its location of a captured image by retrieving its corresponding region from panoramas in a database. In our database, 104 panoramas captured within a local area are stored. For retrieving a user’s location, the query image captured by the user’s planarprojection camera is compared with all the panoramas in the database. SURF is used for finding corresponding points between the query and each panorama. The panorama which gets maximum number of corresponding points is selected as the location. In addition, a user’s view direction is also estimated by reprojecting the center of the query onto the selected panorama. As a result, image based view localization with panoramas can be achieved.